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IN THE UNITED STATES ELECTED OFFICE 
OF THE UNITED STATES PATENT AND TRADEMARK OFFICE 
UNDER THE PATENT COOPERATION TREATY -CHAPTER II 
5 PRELIMINARY AMENDMENT 

APPLICANT: Jiirgen PANDEL ET AL 

DOCKET NO: P01,0063 
SERIAL NO: GROUP ART UNIT : 

EXAMINER : 

10 INTERNATIONAL APPLICATION NO: PCT/DE99/02 763 

INTERNATIONAL FILING DATE: 01 September 1999 
INVENTION: "METHOD AND ARRANGEMENT FOR PROCESSING A 

DIGITIZED PICTURE WITH PIXELS" 

Assistant Commissioner for Patents, 
15 Washington, D.C. 20231 

Sir : 

As a Preliminary Amendment for entry into the 
National Stage for the above -identified PCT application, 
the following is submitted: 

2 0 IN THE SPECIFICATION AND ABSTRACT ; 

Enclosed is a Substitute Specification and 
Abstract. No new matter is added in this Substitute 
Specification and Abstract. A marked-up copy of the 
specification and abstract is also enclosed. 



IN THE DRAWINGS ; 

Please amend the drawings as indicated in the 
attached Drawing Correction Letter. 

IN THE CLAIMS; 

On amended page 2 0 of the claims, delete "Patent 
Claims" and substitute -- WE CLAIM AS OUR INVENTION --. 

Please cancel claims 1-15 without prejudice. 
Please substitute claims 16-30 as follows: 

16. A method for processing a digitized picture 
with pixels, comprising the steps of: 

grouping the pixels into picture blocks; 

segmenting the picture into at least a first 
picture object and a second picture object, at least one 
picture block being assigned to at least a part of an 
edge of the first picture object; 

assigning information about the picture object to 
the at least one picture block; 

coding the picture objects with different quality; 

assigning a quality specification indicating the 
quality with which a picture object is coded to at least 
one macroblock contained in the corresponding picture 
object; and 

determining the quality by a spatial resolution. 

17. The method of claim 16 wherein 

a plurality of picture blocks are in each case 
grouped to form a macroblock; and 

a macroblock is assigned at least to the part of 
the edge . 
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18. The method of claim 17 wherein at least one 
luminance block of the macroblock is assigned at least 
to the part of the edge of the first picture object. 

19. The method of claim 16 in which at least one 
5 picture block is assigned to an entire edge of the first 

picture object. 

20. The method of claim 17 in which information 
about the picture object is in each case assigned to all 
the macroblocks in which the edge is contained. 

10 

21. The method of claim 17 in which the first 
picture object is addressed using a macroblock address 
respectively assigned to a macroblock. 

22. The method of claim 17 in which the second 
15 picture object is addressed using a macroblock address 

respectively assigned to a macroblock. 

23. The method of claim 16 used for coding a 
digitized picture. 

24. The method of claim 16 used for decoding a 
20 digitized picture. 



25. The method of claim 16 used in a mobile 
communications device . 
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26. An arrangement for processing a digitized 
picture with pixels, comprising: 

a processor set up in such a way that the pixels 
are grouped into picture blocks, the picture is segmented 
5 into at least a first picture object and a second picture 
object, at least one picture block being assigned to at 
least a part of an edge of the first picture object, and 
information about the picture object is assigned to the 
at least one picture block; 
10 means for coding the picture objects with different 

quality; 

means for assigning a quality specification 
indicating the quality with which a picture object is 
coded to at least one macroblock contained in the 
15 corresponding picture object; and 

means for determining the quality by a spatial 
resolution . 

27. The arrangement of claim 2 6 in which the 
2 0 processor is set up in such a way that 

a plurality of picture blocks are in each case 
grouped to form a macroblock; and 

a macroblock is assigned at least to the part of 
the edge . 

2 5 28. The arrangement of claim 2 6 used for coding 

a digitized picture. 

29. The arrangement as claimed in claim 2 6 used 
for decoding a digitized picture. 



-5- 



30. The arrangement of claim 26 used in mobile 
communications device . 

REMARKS 

The specification, abstract and drawings have been 
5 amended to place them in appropriate form for U. S. 
practice . 

New claims are presented drawn in accordance with 
U. S. practice. These new claims do not narrow the 
previous claims and were not made for patentability 
10 reasons. Therefore, the Festo Federal Circuit decision 
does not apply to these claims. 

The new patent claims generally correspond to those 
prosecuted before the PCT Office. An additional 
independent claim 31 has been added. 
15 An Information Disclosure Statement is enclosed. 

Respectfully submitted, 
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SPECIFICATION 
TITLE 

METHOD AND ARRANGEMENT FOR PROCESSING A DIGITIZED PICTURE 

WITH PIXELS 

5 BACKGROUND OF THE INVENTION 

The invention relates to a method and an arrangement for 
processing a digitized picture with pixels. 

Such an arrangement and such a method are disclosed in 
10 ITU-T Draft Recommendation H.263, Video Coding for Low Bitrate 
Communication, September, 1997. 

In the arrangement disclosed in Video Coding, supra and 
in the method disclosed in Video Coding, supra, a digitized 
picture to be processed has pixels to which coding information 
15 is assigned in each case. 

Coding information is to be understood hereinafter to 
mean brightness information (luminance value) and/or chrominance 
information (color value) assigned to the respective pixel. 

The pixels are grouped into picture blocks, each picture 
20 block normally having 8 * 8 or 16 * 16 pixels. 

The picture blocks are furthermore grouped into 
macroblocks, each macroblock having four picture blocks which 
contain coding information in the form of brightness information 
(luminance picture blocks) , and two picture blocks which contain 
25 chrominance information (chrominance picture blocks) . 

In the picture coding method which is disclosed in Video 
Coding, supra and is configured in accordance with the H.263/V.2 
standard, provision is made for using so-called difference- 
picture coding for coding a digitized picture. 
30 It is precisely in the case where such difference-picture 

coding is used that, in the case of a moving camera which records 
a scene, or else in the case of a recorded scene which is 
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subjected to changes, the problem arises that the recorded 
background is not stationary. 

This problem area takes on particular significance in the 
use of such methods for picture coding in the context of a mobile 
5 communications device, for example in the case of use in the 
context of a video mobile phone. 

A video mobile phone is to be understood to be an 
apparatus in which a camera for recording a sequence of pictures 
and a telephone are integrated in an apparatus , the telephone 

10 being a radio telephone. 

In the case of customary difference-picture coding, in 
such a case of a greatly changing background, a high proportion 
of an available data rate for the communication is required for 
coding for the greatly changing background. This results in a 

15 smaller proportion of the available data rate remaining for an 
object of interest which can be seen in a foreground of the 
picture and which only changes slightly compared with the 
background. Accordingly, the quality of the respectively coded 
picture is too poor. 

20 However, it is often desirable for an object situated in 

the foreground to have a good quality, while a poorer quality in 
the picture coding with low resolution is entirely acceptable for 
the background . 

Video Coding, supra, describes that, in an optional 

25 coding mode (slice structured mode) , the digitized picture is 
subdivided into rectangles, the so-called slices, and coding 
parameters are respectively allocated separately to each 
rectangle . 

The coding parameters specify, inter alia, the 
30 quantization with which the object contained in the respective 
rectangle is to be coded. 

This procedure disclosed in Video Coding, supra has the 
disadvantage that the entire picture has to be decomposed into 
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individual rectangles. This leads to considerable inflexibility 
in the context of coding a digitized picture. A further 
disadvantage in the case of the procedure disclosed in Video 
Coding, supra is to be seen in the fact that only a uniform 
5 spatial resolution can be used for all the slices. 

ISO/IEC JTC1/SC29/WG11, MPEG-4 Systems, Working Draft 4,0 
of ISO/IEC 14496-1, A. Elef theriadis , C. Herpel, L. Ward (ed.), 
April 16, 1997 discloses an object-based picture coding method 
referred to as an MPEG-4 picture coding method. In this method, 

10 different objects within the digitized picture are coded 
separately from one another. The video data streams arising from 
the coding of the individual picture objects are combined using 
a multiplexer. The method in accordance with the MPEG-4 standard 
has the disadvantage, in particular, that, on account of the 

15 highly complex method of coding the individual video data 
streams, in the case of a multiplicity of picture objects to be 
coded, considerable computing power is required for coding in 
real time and for automatic generation. This results from the 
coded quantity of video data streams of a scene description 

20 describing the interaction of the individual picture objects 
within the digitized picture. The requisite computing power is 
currently not available particularly in the case of mobile 
communications devices, for example a video mobile phone. 

K.-P. Karmann et al, Moving object segmentation based on 

25 adaptive reference images, Proceedings of EUSIPCO-90, pp. 951- 
954, Barcelona, September 1990 discloses a method for segmenting 
a picture into picture objects, the method being referred to as 
moving object segmentation. 

DE 196 54 983 B discloses reducing block artifacts 

30 produced in the context of block-based picture coding by using 
a block edge filter. 

WO 98 15915 A (Univ. Columbia) April 16, 1998 discloses 
a method for processing a digitized picture with pixels, in which 
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the pixels are grouped into picture blocks, in which the picture 
is segmented into at least a first picture object and a second 
picture object. At least one picture block being assigned to at 
least a part of an edge of the first picture object and in which 
5 information about the picture object is assigned to the at least 
one picture block. 

WO 98 15915 A does not disclose that the method is used 
in a mobile communications device. However, this feature is 
disclosed in US-A-5 771 102 (Pelz Rodolfo Mann et al) June 23, 
10 1998, where a method for transmitting pictures between mobile 
telephones is described. 

SUMMARY OF THE INVENTION 
It is an object of the invention to specify a method and 
an arrangement for processing a digitized picture with pixels 
15 which have increased flexibility with regard to the coding of a 
picture and require reduced computing power compared with the 
known methods . 

The problem is solved by means of the method and also by 
means of the arrangement as described as follows. 
20 A method is provided for processing a digitized picture 

with pixels and which has the following steps: 

a) the pixels are grouped into picture blocks, 

b) the picture is segmented into at least a first picture 
object and a second picture object, at least one picture block 

25 being assigned to at least a part of an edge of the first picture 
object and 

c) information about the picture object is assigned to the at 
least one picture block. 

An arrangement for processing a digitized picture with 
30 pixels contains a processor which is set up in such a way that 

a) the pixels are grouped ; into picture blocks, 

b) the picture is segmented into at least a first picture 
object and a second picture object, at least one picture 
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block being assigned to at least a part of an edge of the 
first picture object and 
c) information about the picture object is assigned to the at 
least one picture block. 
5 The invention achieves a simpler method of coding 

picture objects which enables a flexible division of the 
available data rate for coding different picture objects. 

Preferably, a plurality of picture blocks are in each 
case grouped to form a macroblock. A macroblock being assigned 
10 at least to the part of the edge. 

A further refinement provides for at least one 
luminance block of the macroblock to be assigned at least to the 
part of the edge of the first picture object. 

Furthermore, at least one picture block is preferably 
15 assigned to the entire edge of the first picture object. 

Furthermore, a development provides for information 
about the picture object to be in each case assigned to all the 
macroblocks in which the edge of the first picture object is 
contained . 

20 In a further refinement, the first picture object is 

addressed using a macroblock address respectively assigned to a 
macroblock . 

A further refinement provides for the second picture 
object to be addressed using a macroblock address respectively 
25 assigned to a macroblock. 

Preferably, the picture objects are coded with 
different quality, in which case, preferably, a quality 
specification indicating the quality with which a picture object 
is coded is assigned to at least one macroblock contained in the 
30 corresponding picture object. 

The method and the apparatus can be used for coding a 
digitized picture or for decoding a digitized picture. 

The apparatus and the method are suitable for use in 
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a mobile communications device, for example a video mobile phone. 

An exemplary embodiment of the invention is illustrated 
in the figures and is explained in more detail below. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 Figure 1 shows a sketch of a picture which is processed in 

accordance with the exemplary embodiment; 

Figure 2 shows an arrangement of two computers, a camera 
and a screen, by means of which the picture data are coded, 
transmitted, decoded and displayed; 
10 Figure 3 shows a sketch of an apparatus for block-based 

coding of a digitized picture; and 

Figure 4 shows a flow diagram illustrating the method 
steps for coding, transmission and decoding of a digitized 
picture . 

15 DESCRIPTION OF THE PREFERRED EMBODIMENT 

For the purposes of promoting an understanding of the 
principles of the invention, reference will now be made to the 
preferred embodiment illustrated in the drawings and specific 
language will be used to describe the same. It will nevertheless 

20 be understood that no limitation of the scope of the invention 
is thereby intended, such alterations and further modifications 
in the illustrated device, and such further applications of the 
principles of the invention as illustrated therein being 
contemplated as would normally occur to one skilled in the art 

25 to which the invention relates. 

Figure 2 shows an arrangement which comprises two 
computers 202, 208 and a camera 201, illustrating the picture 
coding, transmission of picture data and picture decoding. 

A camera 201 is connected to a first computer 202 via 

30 a line 219. The camera 201 communicates recorded pictures 204 to 
the first computer 202. The first computer 202 has a first 
processor 203, which is connected via a bus 218 to a frame store 
205. A method for picture coding is carried out using the first 
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processor 203 of the first computer 202. Picture data 206 coded 
in this way are transmitted from the first computer 2 02 via a 
communication link 2 07, preferably a line or a radio link, to a 
second computer 208. The second computer 208 contains a second 
5 processor 209, which is connected via a bus 210 to a frame store 
211. A method for picture decoding is carried out using the 
second processor 209. 

Both the first computer 2 02 and the second computer 2 08 
have a respective screen 212 and 213, on which the picture data 

10 204 are displayed, with the display on the screen 212 of the 
first computer 202 normally being only for monitoring purposes. 
Input units, preferably a keyboard 214 or 215, respectively, and 
a computer mouse 216 or 217, respectively, are in each case 
provided to control both the first computer 2 02 and the second 

15 computer 208 . 

The picture data 2 04 which are transmitted from the 
camera 201 via the line 219 to the first computer 202 are data 
in the time domain, while the data 2 06 which are transmitted from 
the first computer 202 to the second computer 208 via the 

20 communication link 207 are picture data in the spectral domain. 

The decoded picture data are displayed on the screen 

213 . 

Figure 3 shows a sketch of an arrangement for carrying 
out a block-based picture coding method in accordance with the 
25 H.2 63 Standard (see Video Coding, supra) . 

A video data stream to be coded with chronologically 
successive digitized pictures is supplied to a picture coding 
unit 301. The digitized pictures are subdivided into macroblocks 
3 02, with each macroblock containing 16x16 pixels. The macroblock 
30 302 comprises 4 picture blocks 303, 304, 305 and 306, with each 
picture block containing 8x8 pixels to which luminance values 
(brightness values) are assigned. Furthermore, each macroblock 
302 comprises two chrominance blocks 307 and 308 with chrominance 
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values (color difference values) allocated to the pixels. 

The picture blocks are supplied to a transformation 
coding unit 309. In the case of difference-picture coding, values 
to be coded for picture blocks in chronologically preceding 
5 pictures are removed from the picture blocks to be coded at that 
time, and only the difference- forming information 310 is supplied 
to the transformation coding unit (discrete cosine transformation 
DCT) 309. For this purpose, the current macroblock 3 02 is 
reported via a link 334 to a motion estimation unit 329. Spectral 

10 coefficients 311 are formed in the transformation coding unit 309 
for the picture blocks and difference picture blocks to be coded, 
and are supplied to a quantization unit 312. 

Quantized spectral coefficients 313 are supplied in a 
backward path both to a scanning unit 314 and to an inverse 

15 quantization unit 315. After a scanning method, for example a 
zigzag scanning method, entropy coding is carried out on the 
scanned spectral coefficients 332, in an entropy coding unit 316 
provided for this purpose. The entropy-coded spectral 
coefficients are transmitted to a decoder as coded picture data 

20 317 via a channel, preferably a line or a radio link. 

An inverse quantization of the quantized spectral 
coefficients 313 is carried out in the inverse quantization unit 
315. Spectral coefficients 318 obtained in this way are supplied 
to an inverse transformation coding unit 319 (inverse discrete 

25 cosine transformation IDCT) . Reconstructed coding values (also 
difference coding values) 320 are supplied in the difference 
picture mode to an adder 321. The adder 321 furthermore receives 
coding values for a picture block, which result from a 
chronologically preceding picture once motion compensation has 

30 already been carried out. The adder 321 is used to form 
reconstructed picture blocks 322, which are stored in a frame 
store 323 . 

Chrominance values 324 for the reconstructed picture 
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blocks 322 are supplied from the frame store 323 to a motion 
compensation unit 325. For brightness values 326, interpolation 
is carried out in an interpolation unit 327 provided for this 
purpose. The interpolation is preferably used to quadruple the 
5 number of brightness values contained in the respective picture 
block. All the brightness values 328 are supplied both to the 
motion compensation unit 325 and to the motion estimation unit 
329. The motion estimation unit 329 also receives the picture 
blocks of the respective macroblock (16x16 pixels) to be coded, 

10 via the link 334. The motion estimation is carried out in the 
motion estimation unit 329, taking account of the interpolated 
brightness values ("motion estimation on a half -pixel basis") . 

The result of the motion estimation is a motion vector 
330 which expresses a local displacement of the selected 

15 macroblock from the chronologically preceding picture to the 
macroblock 3 02 to be coded. 

Both brightness information and chrominance information 
related to the macroblock determined by the motion estimation 
unit 329 are shifted through the motion vector 33 0 and are 

20 subtracted from the coding values of the macroblock 3 02 (see the 
data path 331) . 

The motion estimation thus results in the motion vector 
330 with two motion vector components, a first motion vector 
component BV X and a second motion vector component BV y along the 

25 first direction x and the second direction y: 

The motion vector 33 0 is assigned to the picture block. 
The picture coding unit shown in Figure 3 thus supplies 
a motion vector 330 for all the picture blocks and macro picture 
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blocks . 

Figure 1 shows a picture 100 recorded by the camera 201 
and having pixels, the pixels being grouped into picture blocks 
101. 8x8 pixels are in each case grouped to form a picture block 
5 101. 

Luminance information is assigned to the pixels. Four 
luminance picture blocks 101 are grouped to form a macroblock 
102 . 

Figure 1 shows a first picture object 104, which 

10 describes a person, a second picture object 105, which describes 
a table surface, and a third object 103, which describes a 
picture background. 

The first picture object 104 and the second picture 
object 105 together form a picture foreground. 

15 In a first step (step 401, cf. Figure 4), the picture is 

segmented into a plurality of picture objects. The picture is 
se g men ted in accordance with the method described in Karmann et 
al, supra, this method being referred to as moving object 
segmentation. The segmentation is effected in such a way that an 

20 edge 106, 107 of the first picture object 104 and of the second 
picture object 105, respectively, in each case correspond to a 
block boundary of a macroblock or at least to the block 
boundaries of the luminance picture blocks in a macroblock. 

In a second step (step 4 02) , a set of coding parameters 

25 is in each case assigned to each picture object 103, 104, 105. 

The coding parameters specify, inter alia, the spatial 
resolution to be used for coding the respective picture object, 
motion vectors, coding type (intra- frame coding or inter- frame 
coding), quantization, etc. 

30 Furthermore, for each picture object 103, 104, 105, in 

a further step (step 403) , a quality specification is selected 
and assigned to the respective picture object 103, 104, 105 as 
a coding parameter. The quality specification specifies the 
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quality with which the picture object is to be coded in each 
case . 

In this example, the quality specification is given by 
the specification of the quantization to be chosen. 
5 The coding parameters are stored in a picture object 

header field (object header) assigned to the respective picture 
object 103, 104, 105, coded and transmitted together with the 
remaining picture information to be coded, the picture blocks 
and/or the difference picture information. 
10 In accordance with the above-described method illustrated 

in Figure 3, in a further step (step 404), each picture object 
103, 104, 105 is coded in accordance with the coding parameters 
with the respective quality prescribed in the quality 
specification . 

15 In this case, a foreground object, i.e. the first picture 

object 104 or else the second picture object 105, is coded with 
a better picture quality, i.e. more data rate is available for 
the coding of the first picture object 104 and of the second 
picture object 105 than for the coding of the background picture 

20 object, the third picture object 103. 

It should be noted that it is not necessary for the 
individual picture objects to be disjoint, but the set union of 
all pixels of the first picture object 104, of the second picture 
object 105 and of the third picture object 103 contains all 

25 pixels of the picture 100. 

For the coding of the picture 100, a picture header field 
is provided in each case for the entire picture, various coding 
parameters which are identical for the coding of the entire 
picture being specified in said picture header field. 

30 Thus, a segmentation specification describing the way in 

which the picture 100 is segmented into picture objects 103, 104, 
105 is specified in the picture header field. 

For the coding of the segmentation specification, two 
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bits are provided in the picture header field. Four different 
types of segmentation are distinguished: 

- First segmentation type (code 00) : 

The method described is not used for coding the picture 100. 

- Second segmentation type (code 01) : 

All picture objects including the background picture objects 
are disjoint and exactly fill the predetermined picture format 
of the picture 100. 

- Third segmentation type (code 10) : 

The picture objects are allowed to overlap and are also 
allowed to lie outside a customary picture frame. However, it 
lies within a predetermined frame which is larger than the 
customary picture frame and must not be exceeded. 

- Fourth segmentation type (code 11) : 

With the exception of the background picture object, all 
picture objects are disjoint. The fourth segmentation type 
serves for efficient coding of the background information, 
since already coded background can be stored in a memory, 
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the background memory. Picture background exposed again by a 
moving picture object does not have to be newly coded again. 
The background is allowed to project beyond the predetermined 
picture frame of the picture 100 in order that, in the event 
5 of a movement of the camera 201 recording the picture 100, 

recourse can be had to already coded information. Once again, 
a prescribed frame is determined which is larger than the 
customary picture frame of the picture 100. This prescribed 
frame must not be exceeded. 
10 In a further step (step 405) , the coded information of 

the picture is transmitted as a coded picture from the first 
computer 202 to the second computer 208. 

In a further step (step 406) , the coded picture is 
received by the second computer 208. 
15 In a last step (step 407) , the received coded picture 

information is decoded and the digitized picture is reconstructed 
using the concomitantly transmitted coding parameters and the 
quality specification. 

Different types of picture objects may occur, a 
20 respective type of a picture object being coded by a code in the 
header field of the respective picture object. 

A first type of picture object is a rectangular picture 
object having a width w and a height h. On account of the 
correspondence of the object boundaries (edge of the picture 
25 object) to the edges of the respective macroblocks, the 
rectangular object is addressed by the absolute macroblock 
address of the top left macroblock in the rectangular picture 
obj ect . 

The macroblock address is an address which is assigned 
30 to the respective macroblock and uniquely identifies each 
macroblock in the context of picture coding. 

The width w of the rectangular picture object is coded 
using variable length coding. 
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The macroblocks are addressed in such a way that in the 
picture 100 7 line by line from left to right, a respective value 
of which represents the macroblock address, is incremented from 
macroblock to macroblock. For the coding of a respective picture 
5 object, a picture object start code is provided which specifies 
that the further data relate to coding of a picture object. 
Consequently, the coding of the last macroblock of a picture 
object is in each case followed by either a new picture object 
start code or a new picture start code which specifies that data 
10 of a new picture are subsequently coded. 

If the boundaries of the rectangular picture object do 
not correspond to the macroblock raster, but do correspond to the 
block boundaries of the luminance picture blocks, then the 
relative position of the respective luminance picture blocks with 
15 respect to the macroblock boundaries is coded by additional bits 
in the picture object header field. 

Picture objects which do not have a rectangular structure 
are segmented in such a way that the edge of the respective 
picture object corresponds to the block boundaries of the 
20 macroblocks or at least to the block boundaries of the luminance 
picture blocks. 

In this case, the first macroblock of the picture object 
is addressed by the absolute macroblock address in accordance 
with the addressing scheme described above. 
25 The subsequent macroblocks belonging to the respective 

picture object are addressed using run length coding, as is known 
from the method in accordance with the H.2 61 standard. 

The coding of the last macroblock in the picture object is 
likewise followed by either a new picture object start code or 
30 a new picture start code. 

A third type of picture object is a background picture 
object; in the present case, the third picture object 103 
represents a background picture object. A background picture 
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object describes a background, the information represented in the 
background having less significance to the observer than the 
information described in a foreground picture object. 

In contrast to the slice structured mode disclosed in 
5 Video Coding, supra, the background picture object is not 
necessarily rectangular even in the case of a rectangular picture 
object, the rectangular object. 

For the coding of a background picture object, the 
process begins with a picture object start code. The addressing 
10 of the macroblocks of the background picture object depends on 
the selected segmentation type described above. 

In the case of the second segmentation type (code 01) , 
the position of all the background macroblocks, i.e. all the 
macroblocks which are contained in the background picture object, 
15 is unambiguously determined after the coding of the last picture 
object, and they can be successively addressed in the manner 
described above in accordance with the addressing of the 
macroblocks. Macroblocks which do not belong to the picture 
background need not be skipped by run length coding. 
20 In the case of the second segmentation type and also in 

the case of the third segmentation type (code 10 and code 11) , 
the addressing is effected as in the case of the picture objects 
having a non-rectangular structure. 

A number of alternatives to the exemplary embodiment 
25 described above are explained below. 

As an alternative to the variable length coding, fixed 
length coding can be used for coding the width w of the 
rectangular picture object. 

Differential coding from the size and the position of the 
30 rectangular picture object in a predecessor picture of the 
picture 100 can also be used in the context of the method. 

An alternative to run length coding in the coding of 
macroblocks of a picture object which does not have a rectangular 
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structure is so-called shape coding, as is described in 
Eleftheriadis, et al . Differential coding from the position of 
the picture object in the predecessor picture can also be used 
for coding the macroblocks . 
5 In the context of this method described above, provision 

may furthermore be made for using only rectangular picture 
objects. This leads to a simplification in the coding since, in 
this case, it is only necessary to increment the macroblock 
address by w macroblocks when skipping macroblocks which belong 

10 to a rectangular picture object. This results in a reduction of 
required computation operations in the context of coding. 

Those picture objects which are of particular interest 
to an observer of the picture 100 are coded with a higher quality 
than the picture objects, in particular the background picture 

15 objects, which are of less interest to the observer of the 
picture 100 . 

Since a block-based picture coding method is used, so- 
called block artifacts, i.e. visible block edges, occur to an 
increased extent in the picture areas coded with a lower quality. 

20 In an alternative embodiment, the artifacts are reduced 

by using a block edge filter. Such a block edge filtering is 
disclosed in DE 196 54 983 B. The block edge filtering can be 
used both in the context of decoding and in the feedback loop of 
the coder, as is illustrated in Figure 3, as so-called "filter 

25 in the loop" . 

The block edge filtering is preferably used only for the 
picture objects which are coded with a coarse quantization, i.e. 
with a low quality. 

In the event of a high degree of movement within a 

30 sequence of pictures, however, it can happen, even in the case 
of the picture objects which are coded with increased quality, 
that a relatively coarse quantization has to be used for a short 
time on account of the limited data rate. In this case, block 
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edge filtering is temporarily used for this time period of 
increased motion, which is optionally determined by assessment 
of the motion vectors determined for the picture objects. 

The filter parameters of the filters used for block edge 
5 filtering can be dynamically adapted to the respective picture 
to be coded in accordance with the method disclosed in DE 196 54 
983 B. 

Furthermore, transmission error protection may be 
provided for the transmission of the coded pictures, for example 

10 a CRC code (Cyclic Redundancy Check) or else a so-called 
punctured code. In this case, preferably those picture objects 
which are coded with an increased quality are protected against 
transmission errors by an error protection mechanism which is 
"more powerful" than the error protection mechanism used for 

15 picture objects which were coded with a lower quality. 

The term "more powerful" is to be understood to the 
effect that an increased number of transmission errors can be 
detected and corrected by the respective error protection method. 

In a variation of the invention, the quality 

20 specification may also be given by the specification of a spatial 
resolution to be chosen. For this case, the foreground object, 
i.e. the first picture object 104 or else the second picture 
object 105, is coded with a better picture quality, i.e. with a 
higher spatial resolution, than the background picture object, 

25 the third picture object 103. 

While the invention has been illustrated and described in 
detail in the drawings and foregoing description, the same is to 
be considered as illustrative and not restrictive in character, 
it being understood that only the preferred embodiment has been 

30 shown and described and that all changes and modifications that 
come within the spirit of the invention are desired to be 
protected . 



SUBSTITUTE SPECIFICATION 



GR 98 P 2749 
Description 



Method and arrangement for processing a digitized 
picture with pixels 

5 

The invention relates to a method and an 
arrangement for processing a digitized picture with 
pixels . 

Such an arrangement and such a method are 
10 disclosed in [1] . 

In the arrangement disclosed in [1] and in the 
method disclosed in [1], a digitized picture to be 
processed has pixels to which coding information is 
assigned in each case. 
15 Coding information is to be understood 

hereinafter to mean brightness information (luminance 
value) and/or chrominance information (color value) 
assigned to the respective pixel. 

The pixels are grouped into picture blocks, 
20 each picture block normally having 8*8 or 16 * 16 
pixels . 

The picture blocks are furthermore grouped into 
macroblocks, each macroblock having four picture blocks 
which contain coding information in the form of 

25 brightness information (luminance picture blocks), and 
two picture blocks which contain chrominance 
information (chrominance picture blocks). 

In the picture coding method which is disclosed 
in [1] and is configured in accordance with the 

30 H.263/V.2 standard, provision is made for using so- 
called difference-picture coding for coding a digitized 
picture , 

It is precisely in the case where such 
difference-picture coding is used that, in the case of 
35 a moving camera which records 
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a scene, or else in the case of a recorded scene which 
is subjected to changes, the problem arises that the 
recorded background is not stationary. 

This problem area takes on particular 
5 significance in the use of such methods for picture 
coding in the context of a mobile communications 
device, for example in the case of use in the context 
of a video mobile phone. 

A video mobile phone is to be understood to be 

10 an apparatus in which a camera for recording a sequence 
of pictures and a telephone are integrated in an 
apparatus, the telephone being a radio telephone. 

In the case of customary difference-picture 
coding, in such a case of a greatly changing 

15 background, a high proportion of an available data rate 
for the communication is required for coding for the 
greatly changing background, with the result that a 
smaller proportion of the available data rate remains 
for an object of interest which can be seen in a 

20 foreground of the picture and only changes slightly 
compared with the background, and, accordingly, the 
quality of the respectively coded picture is too poor. 

However, it is often desirable for an object 
situated in the foreground to have a good quality, 

25 while a poorer quality in the picture coding with low 
resolution is entirely acceptable for the background. 

[1] describes that, in an optional coding mode 
(slice structured mode), the digitized picture is 
subdivided into rectangles, the so-called slices, and 

30 coding parameters are respectively allocated separately 
to each rectangle. 
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The coding parameters specify, inter alia, the 
quantization with which the object contained in the 
respective rectangle is to be coded. 

This procedure disclosed in [1] has the 
5 disadvantage that the entire picture has to be 
decomposed into individual rectangles. This leads to 
considerable inflexibility in the context of coding a 
digitized picture. A further disadvantage in the case 
of the procedure disclosed in [1] is to be seen in the 

10 fact that only a uniform spatial resolution can be used 
for all the slices. 

[2] discloses an object-based picture coding 
method referred to as an MPEG-4 picture coding method. 
In this method, different objects within the digitized 

15 picture are coded separately from one another. The 
video data streams arising from the coding of the 
individual picture objects are combined using a 
multiplexer. The method in accordance with the MPEG-4 
standard has the disadvantage, in particular, that, on 

20 account of the highly complex method of coding the 
individual video data streams, in the case of a 
multiplicity of picture objects to be coded, 
considerable computing power is required for coding in 
real time and for automatic generation - resulting from 

25 the coded quantity of video data streams - of a scene 
description describing the interaction of the 
individual picture objects within the digitized 
picture. The requisite computing power is currently not 
available particularly in the case of mobile 

30 communications devices, for example a video mobile 
phone . 

[3] discloses a method for segmenting a picture 
into picture objects, said method being referred to as 
moving object segmentation. 

35 
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[4] discloses reducing block artifacts produced 
in the context of block-based picture coding by using a 
block edge filter. 

[5] discloses a method for processing a 
digitized picture with pixels, in which the pixels are 
grouped into picture blocks, in which the picture is 
segmented into at least a first picture object and a 
second picture object, at least one picture block being 
assigned to at least a part of an edge of the first 
picture object and in which information about the 
picture object is assigned to the at least one picture 
block. 

[5] does not disclose that the method is used 
in a mobile communications device. However, this 
feature is disclosed in [6], where a method for 
transmitting pictures between mobile telephones is 
described. 

Consequently, the invention is based on the 
problem of specifying a method and an arrangement for 
processing a digitized picture with pixels, which have 
increased flexibility with regard to the coding of a 
picture and require reduced computing power compared 
with the known methods . 

The problem is solved by means of the method 
and also by means of the arrangement having the 
features in accordance with the independent patent 
claims . 

A method for processing a digitized picture 
with pixels has the following steps: 

a) the pixels are grouped into picture blocks, 

b) the picture is segmented into at least a first 
picture object and a second picture object, at least 
one picture block being assigned to at least a part of 
an edge of the first picture object and 
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c) information about the picture object is assigned 
to the at least one picture block. 

An arrangement for processing a digitized 
picture with pixels contains a processor which is set 
up in such a way that 

a) the pixels are grouped into picture blocks, 

b) the picture is segmented into at least a first 
picture object and a second picture object, at 
least one picture block being assigned to at least 
a part of an edge of the first picture object and 

c) information about the picture object is assigned 
to the at least one picture block. 
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The invention achieves a simpler method of 
coding picture objects which enables a flexible 
division of the available data rate for coding 
different picture objects. 
5 Preferred developments of the invention emerge 

from the dependent claims. 

Preferably, a plurality of picture blocks are 
in each case grouped to form a macroblock. A macroblock 
is assigned at least to the part of the edge. 
10 A further refinement provides for at least one 

luminance block of the macroblock to be assigned at 
least to the part of the edge of the first picture 
ob j ect . 

Furthermore, at least one picture block is 
15 preferably assigned to the entire edge of the first 
picture object. 

Furthermore, a development provides for 
information about the picture object to be in each case 
assigned to all the macroblocks in which the edge of 
20 the first picture object is contained. 

In a further refinement, the first picture 
object is addressed using a macroblock address 
respectively assigned to a macroblock. 

A further refinement provides for the second 
25 picture object to be addressed using a macroblock 
address respectively assigned to a macroblock. 

Preferably,, the picture objects are coded with 
different quality, in which case, preferably, a quality 
specification indicating the quality with which a 
30 picture object is coded is assigned to at least one 
macroblock contained in the corresponding picture 
object . 
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The method and the apparatus can be used for 
coding a digitized picture or for decoding a digitized 
picture . 

The apparatus and the method are suitable for 
5 use in a mobile communications device, for example a 
video mobile phone. 

An exemplary embodiment of the invention is 
illustrated in the figures and is explained in more 
detail below. 
10 In the figures: 

Figure 1 shows a sketch of a picture which is 
processed in accordance with the exemplary 
embodiment ; 

Figure 2 shows an arrangement of two computers, a 
15 camera and a screen, by means of which the 

picture data are coded, transmitted, decoded 
and displayed; 

Figure 3 shows a sketch of an apparatus for block- 
based coding of a digitized picture; 
20 Figure 4 shows a flow diagram illustrating the method 
steps for coding, transmission and decoding 
of a digitized picture. 
Figure 2 shows an arrangement which comprises 
two computers 202, 208 and a camera 201, illustrating 
25 the picture coding, transmission of picture data and 
picture decoding. 

A camera 201 is connected to a first computer 
202 via a line 219. The camera 201 communicates 
recorded pictures 204 to the first computer 202. The 
30 first computer 202 has a first processor 203, which is 
connected via a bus 218 to a frame store 205. A method 
for picture coding is carried out using the first 
processor 203 of the first computer 202. Picture data 
206 coded 

35 



GR 98 P 2749 - 7 - 

in this way are transmitted from the first computer 202 
via a communication link 207, preferably a line or a 
radio link, to a second computer 208 . The second 
computer 208 contains a second processor 209, which is 
connected via a bus 210 to a frame store 211. A method 
for picture decoding is carried out using the second 
processor 209. 

Both the first computer 202 and the second 
computer 208 have a respective screen 212 and 213, on 
which the picture data 204 are displayed, with the 
display on the screen 212 of the first computer 202 
normally being only for monitoring purposes. Input 
units, preferably a keyboard 214 or 215, respectively, 
and a computer mouse 216 or 217, respectively, are in 
each case provided to control both the first computer 
202 and the second computer 208. 

The picture data 204 which are transmitted from 
the camera 201 via the line 219 to the first computer 
202 are data in the time domain, while the data 206 
which are transmitted from the first computer 202 to 
the second computer 208 via the communication link 207 
are picture data in the spectral domain. 

The decoded picture data are displayed on the 
screen 213. 

Figure 3 shows a sketch of an arrangement for 
carrying out a block-based picture coding method in 
accordance with the H.263 Standard (see [1]). 

A video data stream to be coded and with 
chronologically successive digitized pictures is 
supplied to a picture coding unit 301. The digitized 
pictures are subdivided into macroblocks 302, with each 
macroblock containing 16x16 pixels. The macroblock 302 
comprises 4 picture blocks 303, 304, 305 and 306, with 
each picture block containing 8x8 pixels to which 
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luminance values (brightness values) are assigned. 
Furthermore, each macroblock 302 comprises two 
chrominance blocks 307 and 308 with chrominance values 
(color difference values) allocated to the pixels. 

The picture blocks are supplied to a 
transformation coding unit 309. In the case of 
difference-picture coding, values to be coded for 
picture blocks in chronologically preceding pictures 
are removed from the picture blocks to be coded at that 
time, and only the difference-forming information 310 
is supplied to the transformation coding unit (discrete 
cosine transformation DCT) 309. For this purpose, the 
current macroblock 302 is reported via a link 334 to a 
motion estimation unit 329. Spectral coefficients 311 
are formed in the transformation coding unit 309 for 
the picture blocks and difference picture blocks to be 
coded, and are supplied to a quantization unit 312. 

Quantized spectral coefficients 313 are 
supplied in a backward path both to a scanning unit 314 
and to an inverse quantization unit 315. After a 
scanning method, for example a zigzag scanning method, 
entropy coding is carried out on the scanned spectral 
coefficients 332, in an entropy coding unit 316 
provided for this purpose. The entropy-coded spectral 
coefficients are transmitted to a decoder as coded 
picture data 317 via a channel, preferably a line or a 
radio link. 

Inverse quantization of the quantized spectral 
coefficients 313 is carried out in the inverse 
quantization unit 315. Spectral coefficients 318 
obtained in this way are supplied to an inverse 
transformation coding unit 319 (inverse discrete cosine 
transformation IDCT) . Reconstructed coding values (also 
difference coding values) 320 are supplied in the 
difference picture mode to an adder 321. The adder 321 
furthermore receives coding values for a picture block, 
which result from a chronologically preceding picture 
once motion compensation 
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has already been carried out. The adder 321 is used to 
form reconstructed picture blocks 322, which are stored 
in a frame store 323. 

Chrominance values 324 for the reconstructed 
picture blocks 322 are supplied from the frame store 
323 to a motion compensation unit 325. For brightness 
values 32 6, interpolation is carried out in an 
interpolation unit 327 provided for this purpose. The 
interpolation is preferably used to quadruple the 
number of brightness values contained in the respective 
picture block. All the brightness values 328 are 
supplied both to the motion compensation unit 325 and 
to the motion estimation unit 329. The motion 
estimation unit 329 also receives the picture blocks of 
the respective macroblock (16x16 pixels) to be coded, 
via the link 334. The motion estimation is carried out 
in the motion estimation unit 329, taking account of 
the interpolated brightness values ("motion estimation 
on a half-pixel basis") . 

The result of the motion estimation is a motion 
vector 330 which expresses a local displacement of the 
selected macroblock from the chronologically preceding 
picture to the macroblock 302 to be coded. 

Both brightness information and chrominance 
information related to the macroblock determined by the 
motion estimation unit 329" are shifted through the 
motion vector 330 and are subtracted from the coding 
values of the macroblock 302 (see the data path 331) . 

The motion estimation thus results in the 
motion vector 330 with two motion vector components, a 
first motion vector component BV X and a second motion 
vector component BV y along the first direction x and 
the second direction y: 
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The motion vector 330 is assigned to the 
picture block. 

The picture coding unit shown in Figure 3 thus 
supplies a motion vector 330 for all the picture blocks 
and macro picture blocks. 

Figure 1 shows a picture 100 recorded by the 
camera 201 and having pixels, the pixels being grouped 
into picture blocks 101. 8x8 pixels are in each case 
grouped to form a picture block 101. 

Luminance information is assigned to the 
pixels. Four luminance picture blocks 101 are grouped 
to form a macroblock 102. 

Figure 1 shows a first picture object 104, 
which describes a person, a second picture object 105, 
which describes a table surface, and a third object 
103, which describes a picture background. 

The first picture object 104 and the second 
picture object 105 together form a picture foreground. 

In a first step (step 401, cf. Figure 4 ) , the 
picture is segmented into a plurality of picture 
objects. The picture is segmented in accordance with 
the method described in [3], this method being referred 
to as moving object segmentation. The segmentation is 
effected in such a way that an edge 106, 107 of the 
first picture object 104 and of the second picture 
object 105, respectively, in each case correspond to a 
block boundary of a macroblock or at least to the block 
boundaries of the luminance picture blocks in a 
macroblock. 
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In a second step (step 402), a set of coding 
parameters is in each case assigned to each picture 
object 103, 104, 105. 

The coding parameters specify, inter alia, the 
spatial resolution to be used for coding the respective 
picture object, motion vectors, coding type (intra- 
frame coding or inter-frame coding) , quantization, etc. 

Furthermore, for each picture object 103, 104, 
105, in a further step (step 403), a quality 
specification is selected and assigned to the 
respective picture object 103, 104, 105 as a coding 
parameter. The quality specification specifies the 
quality with which the picture object is to be coded in 
each case. 

In this example, the quality specification is 
given by the specification of the quantization to be 
chosen. 

The coding parameters are stored in a picture 
object header field (object header) assigned to the 
respective picture object 103, 104, 105, coded and 
transmitted together with the remaining picture 
information to be coded, the picture blocks and/or the 
difference picture information. 

In accordance with the above-described method 
illustrated in Figure 3 , in a further step (step 404), 
each picture object 103, 104, 105 is coded in 
accordance with the coding parameters with the 
respective quality prescribed in the quality 
specification . 

In this case, a foreground object, i.e. the 
first picture object 104 or else the second picture 
object 105, is coded with a better picture quality, 
i.e. more data rate is available for the coding of the 
first picture object 104 and of the second picture 
object 105 than for the coding of the background 
picture object, the third picture object 103. 
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It should be noted that it is not necessary for 
the individual picture objects to be disjoint, but the 
set union of all pixels of the first picture object 
104, of the second picture object 105 and of the third 
picture object 103 contains all pixels of the picture 
100. 

For the coding of the picture 100, a picture 
header field is provided in each case for the entire 
picture, various coding parameters which are identical 
for the coding of the entire picture being specified in 
said picture header field. 

Thus, a segmentation specification describing 
the way in which the picture 100 is segmented into 
picture objects 103, 104, 105 is specified in the 
picture header field. 

For the coding of the segmentation 
specification, two bits are provided in the picture 
header field. Four different types of segmentation are 
distinguished: 

- First segmentation type (code 00) : 

The method described is not used for coding the 
picture 100. 

- Second segmentation type (code 01) : 

All picture objects including the background picture 
objects are disjoint and exactly fill the 
predetermined picture format of the picture 100. 

- Third segmentation type (code 10) : 

The picture objects are allowed to overlap and are 
also allowed to lie outside a customary picture 
frame. However, it lies within a predetermined frame 
which is larger than the customary picture frame and 
must not be exceeded. 

- Fourth segmentation type (code 11) : 

With the exception of the background picture object, 
all picture objects are disjoint. The fourth 
segmentation type serves for efficient coding of the 
background information, since already coded 
background can be stored in a memory, 
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the background memory. Picture background exposed 
again by a moving picture object does not have to be 
newly coded again. The background is allowed to 
project beyond the predetermined picture frame of the 
5 picture 100 in order that, in the event of a movement 

of the camera 201 recording the picture 100, recourse 
can be had to already coded information. Once again, 
a prescribed frame is determined which is larger than 
the customary picture frame of the picture 100. This 
10 prescribed frame must not be exceeded. 

In a further step (step 405) , the coded 
information of the picture is transmitted as a coded 
picture from the first computer 202 to the second 
computer 20 8. 

15 In a further step (step 406) , the coded picture 

is received by the second computer 208. 

In a last step (step 407) , the received coded 
picture information is decoded and the digitized 
picture is reconstructed using the concomitantly 

20 transmitted coding parameters and the quality 
specification . 

Different types of picture objects may occur, a 
respective type of a picture object being coded by a 
code in the header field of the respective picture 

25 object. 

A first type of picture object is a rectangular 
picture object having a width w and a height h. On 
account of the correspondence of the object boundaries 
(edge of the picture object) to the edges of the 

30 respective macroblocks, the rectangular object is 
addressed by the absolute macroblock address of the top 
left macroblock in the rectangular picture object. 

The macroblock address is an address which is 
assigned to the respective macroblock and uniquely 

35 identifies each macroblock in the context of picture 
coding . 
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The width w of the rectangular picture object 
is coded using variable length coding. 

The macroblocks are addressed in such a way 
that in the picture 100, line by line from left to 
5 right, a respective value which represents the 
macroblock address is incremented from macroblock to 
macroblock. For the coding of a respective picture 
object, a picture object start code is provided which 
specifies that the further data relate to coding of a 

10 picture object. Consequently, the coding of the last 
macroblock of a picture object is in each case followed 
by either a new picture object start code or a new 
picture start code which specifies that data of a new 
picture are subsequently coded. 

15 If the boundaries of the rectangular picture 

object do not correspond to the macroblock raster, but 
do correspond to the block boundaries of the luminance 
picture blocks, then the relative position of the 
respective luminance picture blocks with respect to the 

20 macroblock boundaries is coded by additional bits in 
the picture object header field. 

Picture objects which do not have a rectangular 
structure are segmented in such a way that the edge of 
the respective picture object corresponds to the block 

25 boundaries of the macroblocks or at least to the block 
boundaries of the luminance picture blocks. 

In this case, the first macroblock of the 
picture object is addressed by the absolute macroblock 
address in accordance with the addressing scheme 

30 described above. 

The subsequent macroblocks belonging to the 
respective picture object are addressed using run 
length coding, as is known from the method in 
accordance with the H.261 standard. 

35 
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The coding of the last macroblock in the 
picture object is likewise followed by either a new 
picture object start code or a new picture start code. 

A third type of picture object is a background 
5 picture object; in the present case, the third picture 
object 103 represents a background picture object. A 
background picture object describes a background, the 
information represented in the background having less 
significance to the observer than the information 

10 described in a foreground picture object. 

In contrast to the slice structured mode 
disclosed in [1], the background picture object is not 
necessarily rectangular even in the case of a 
rectangular picture object, the rectangular object. 

15 For the coding of a background picture object, 

the process begins with a picture object start code. 
The addressing of the macroblocks of the background 
picture object depends on the selected segmentation 
type described above. 

20 In the case of the second segmentation type 

(code 01), the position of all the background 
macroblocks, i.e. all the macroblocks which are 
contained in the background picture object, is 
unambiguously determined after the coding of the last 

25 picture object, and they can be successively addressed 
in the manner described above in accordance with the 
addressing of the macroblocks. Macroblocks which do not 
belong to the picture background need not be skipped by 
run length coding. 

30 In the case of the second segmentation type and 

also in the case of the third segmentation type (code 
10 and code 11) , the addressing is effected as in the 
case of the picture objects having a non-rectangular 
structure . 

35 
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A number of alternatives to the exemplary 
embodiment described above are explained below. 

As an alternative to the variable length 
coding, fixed length coding can be used for coding the 
5 width w of the rectangular picture object. 

Differential coding from the size and the 
position of the rectangular picture object in a 
predecessor picture of the picture 100 can also be used 
in the context of the method. 
10 An alternative to run length coding in the 

coding of macroblocks of a picture object which does 
not have a rectangular structure is so-called shape 
coding, as is described in [2] . Differential coding 
from the position of the picture object in the 
15 predecessor picture can also be used for coding the 
macroblocks . 

In the context of this method described above, 
provision may furthermore be made for using only 
rectangular picture objects. This leads to a 

20 simplification in the coding since, in this case, it is 
only necessary to increment the macroblock address by w 
macroblocks when skipping macroblocks which belong to a 
rectangular picture object. This results in a reduction 
of required computation operations in the context of 

2 5 coding. 

Those picture objects which are of particular 
interest to an observer of the picture 100 are coded 
with a higher quality than the picture objects, in 
particular the background picture objects, which are of 
30 less interest to the observer of the picture 100. 

Since a block-based picture coding method is 
used, so-called block artifacts, i.e. visible block 
edges, occur to an increased extent in the picture 
areas coded with a lower quality. 

35 
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In an alternative embodiment, said artifacts 
are reduced by using a block edge filter. Such a block 
edge filtering is disclosed in [4] . The block edge 
filtering can be used both in the context of decoding 
and in the feedback loop of the coder, as is 
illustrated in Figure 3 , as so-called "filter in the 
loop" . 

The block edge filtering is preferably used 
only for the picture objects which are coded with 
coarse quantization, i.e. with a low quality. 

In the event of high degree of -movement within 
a sequence of pictures, however, it can happen, even in 
the case of the picture objects which are coded with 
increased quality, that a relatively coarse 
quantization has to be used for a short time on account 
of the limited data rate. In this case, block edge 
filtering is temporarily used for this time period of 
increased motion, which is optionally determined by 
assessment of the motion vectors determined for the 
picture objects . 

The filter parameters of the filters used for 
block edge filtering can be dynamically adapted to the 
respective picture to be coded in accordance with the 
method disclosed in [4], 

Furthermore, transmission error protection may 
be provided for the transmission of the coded pictures, 
for example a CRC code (Cyclic Redundancy Check) or 
else a so-called punctured code. In this case, 
preferably those picture objects which are coded with 
an increased quality are protected against transmission 
errors by an error protection mechanism which is "more 
powerful" than the error protection mechanism used for 
picture objects which were coded with a lower quality. 

The term "more powerful" is to be understood to 
the effect that an increased number of transmission 
errors can be detected 
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and corrected by the respective error protection 
method. 

In a variant, the quality specification may 
also be given by the specification of a spatial 
5 resolution to be chosen. For this case, the foreground 
object, i.e. the first picture object 104 or else the 
second picture object 105, is coded with a better 
picture quality, i.e. with a higher spatial resolution, 
than the background picture object, the third picture 
10 object 103. 
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Patent Claims 



1. A method for processing a digitized picture (100) 
with pixels, 

5 a) in which the pixels are grouped into picture 
blocks, 

b) in which the picture is segmented into at least a 
first picture object (104) and a second picture 
object (105), at least one picture block being 

10 assigned to at least a part of an edge of the 

first picture object, 

c) in which information about the picture object is 
assigned to the at least one picture block, 

d) in which the picture objects are coded with 
15 different quality, 

e) in which a quality specification indicating the 
quality with which a picture object is coded is 
assigned to at least one macroblock (102) 
contained in the corresponding picture object, and 

20 f) in which the quality is determined by a spatial 
resolution . 

2. The method as claimed in claim 1, 

a) in which a plurality of picture blocks are in each 
case grouped to form a macroblock, and 
25 b) in which a macroblock is assigned at least to the 
part of the edge . 

3. The method as claimed in claim 2, 

in which at least one luminance block of the macroblock 
is assigned at least to the part of the edge of the 
30 first picture object. 

4. The method as claimed in one of claims 1 to 3, 

in which at least one picture block is assigned to the 
entire edge of the first picture object. 

5. The method as claimed in one of claims 2 to 4, 

35 in which information about the picture object is in 
each case assigned to all the macroblocks in which the 
edge is contained. 
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6. The method as claimed in one of claims 2 to 5, 

in which the first picture object is addressed using a 

macroblock address respectively assigned to a 

macroblock. 

5 7. The method as claimed in one of claims 2 to 6, 

in which the second picture object is addressed using a 
macroblock address respectively assigned to a 
macroblock. 

8. The method as claimed in one of claims 1 to 7, 
10 used for coding a digitized picture. 

9. The method as claimed in one of claims 1 to 7, 
used for decoding a digitized picture. 

10. The method as claimed in one of claims 1 to 9, 
used in a mobile communications device. 

15 11. An arrangement for processing a digitized picture 
(100) with pixels, 

having a processor which is set up in such a way that 

a) the pixels are grouped into picture blocks (101), 

b) the picture is segmented into at least a first 
20 picture object (104) and a second picture object 

(105) , at least one picture block being assigned 
to at least a part of an edge of the first picture 
object, and 

c) information about the picture object is assigned 
25 to the at least one picture block, 

that the picture objects are coded with different 
quality, 

that a quality specification indicating the quality 
with which a picture object is coded is assigned to at 
30 least one macroblock contained in the corresponding 
picture object, and 

that the quality is determined by a spatial resolution. 
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12. The arrangement as claimed in claim 11, 

in which the processor is set up in such a way that 
a) a plurality of picture blocks are in each case 
grouped to form a macroblock, and 
5 b) a macroblock is assigned at least to the part of 
the edge. 

13. The arrangement as claimed in claim 11 or 12, 
used for coding a digitized picture. 

14. The arrangement as claimed in claim 11 or 12 f 
10 used for decoding a digitized picture. 

15. The arrangement as claimed in one of claims 11 to 
14, 

used in a mobile communications device. 
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Method and arrangement for processing a digitized 
picture with pixels 

Pixels of the picture are grouped into picture 
blocks. The picture is segmented into at least a first 
picture object and a second picture object, at least 
one picture block being assigned at least to a part of 
an edge of the first picture object. Information about 
the picture object is assigned to the at least one 
picture block. 
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ABSTRACT OF THE DISCLOSURE 

In a method and arrangement for processing a digitized 
picture with pixels, pixels of the picture are grouped into 
picture blocks. The picture is segmented into at least a first 
picture object and a second picture object, at least one picture 
block being assigned at least to a part of an edge of the first 
picture object. Information about the picture object is assigned 
to the at least one picture block. 
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Erklarung Fur Patentanmeldungen Mit Vollmacht 

German Language Declaration 



Als nachstehend benannter Erfinder erklare ich hiermit As a below named inventor, I hereby declare that 

an Eides Statt: 



dass mein Wohnsitz, meine Postanschrift, und meine 
Staatsangehorigkeit den im Nachstehenden nach 
meinem Namen aufgefuhrten Angaben entsprechen, 



dass ich, nach bestem Wissen der ursprungliche, 
erste und alleinige Erfinder (falls nachstehend nur ein 
Name angegeben ist) oder ein ursprQnglicher, erster 
und Miterfinder (falls nachstehend mehrere Namen 
aufgefuhrt sind) des Gegenstandes bin, fur den dieser 
Antrag gestellt wird und fur den ein Patent beantragt 
wird fur die Erfindung mit dem Titel; 



Verfahren und Anordnunq zur Bearbeituna 
eines diaitalisierten Bildes mit Bildpunkten 



deren Beschreibung 

(zutreffendes ankreuzen) 
hier beigefugt ist. 
am 



als 



PCT Internationale Anmeldung 

PCT Anmeldungsnummer 

eingereicht wurde und am 



abgeandert wurde (falls tatsachlich abgeandert). 



Ich bestatige hiermit, dass ich den Inhalt der obigen 
Patentanmeldung einschliesslich der Anspruche 
durchgesehen und verstanden habe, die eventuell 
durch einen Zusatzantrag wie oben erwahnt abgean- 
dert wurde. 



Ich erkenne meine Pflicht zur Offenbarung irgendwel- 
cher Informationen, die fur die Prufung der vorliegen- 
den Anmeldung in Einklang mit Absatz 37, Bundes- 
gesetzbuch, Paragraph 1.56(a) von Wichtigkeit sind, 



Ich beanspruche hiermit auslandische Prioritatsvor- 
teile gemass Abschnitt 35 der Zivilprozessordnung der 
Vereinigten Staaten, Paragraph 119 aller unten ange- 
gebenen Auslandsanmeldungen for ein Patent oder 
eine Erfindersurkunde, und habe auch alle Auslands- 
anmeldungen fur ein Patent oder eine Erfindersurkun- 
de nachstehend gekennzeichnet, die ein Anmelde- 
datum haben, das vor dem Anmeldedatum der An- 
meldung liegt, fur die Prioritat beansprucht wird. 



My residence, post office address and citizenship are 
as stated below next to my name, 



I believe I am the original, first and sole inventor (if 
only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the 
subject matter which is claimed and for which a patent 
is sought on the invention entitled 



the specification of which 

(check one) 

s attached hereto. 
□ was filed on 



PCT international application 

PCT Application No. 

and was amended on 



as 



(if applicable) 



I hereby state that I have reviewed and understand the 
contents of the above identified specification, inclu- 
ding the claims as amended by any amendment refer 
red to above. 



I acknowledge the duty to disclose information which 
is material to the examination of this application in 
accordance with Title 37, Code of Federal Regula- 
tions, §1. 56(a). 



I hereby claim foreign priority benefits under Title 35, 
United States Code, §119 of any foreign applications j 
for patent or inventor's certificate listed below and 
have also identified below any foreign application for 
patent or inventor's certificate having a filing date 
before that of the application on which priority is clai- 
med: 



Page 1 of 4 



Form PTO-FB-240 (8-83) 



Patent and Trademark Office-U.S. DEPARTMENT OF COMMERCE 



German Language Declaration 


Prior foreign apppfications 
Prioritat beansprucht 


Priority Claimed 


198 44 664.0 Germany 29. September 1998 \E\ □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 




□ □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 




□ □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 


Ich beanspruche hiermit gemass Absatz 35 der Zivil- 
prozessordnung der Vereinigten Staaten, Paragraph 
120, den Vorzug aller unten aufgefuhrten Anmel- 
dungen und falls der Gegenstand aus jedem An- 
spruch dieser Anmeldung nicht in einer fruheren ame- 
rikanischen Patentanmeldung laut dem ersten Para- 
graphen des Absatzes 35 der Zivilprozefcordnung der 
Vereinigten Staaten, Paragraph 122 offenbart ist, 
erkenne ich gemass Absatz 37, Bundesgesetzbuch, 
Paragraph 1.56(a) meine Pflicht zur Offenbarung von 
Informationen an, die zwischen dem Anmeldedatum 
der fruheren Anmeldung und dem nationalen oder 
PCT internationaien Anmeldedatum dieser Anmel- 
dung bekannt geworden sind. 


I hereby claim the benefit under Title 35. United Sta- 
tes Code. §120 of any United States application(s) 
listed below and, insofar as the subject matter of each 
of the claims of this application is not disclosed in the 
prior United States application in the manner provided 
by the first paragraph of Title 35, United States Code, 
§122, I acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal 
Regulations, §1. 56(a) which occured between the 
filing date of the prior application and the national or 
PCT international filing date of this application. 


(Application Serial No.) (Filing Date) 
(Anmeldeseriennummer) (Anmeldedatum) 


(Status) (Status) 
(patentiert, anhangig, (patented, pending, 
aufgegeben) abandoned) 


(Application Serial No.) (Filing Date) 
(Anmeldeseriennummer) (Anmeldedatum) 


(Status) (Status) 
(patentiert, anhangig, (patented, pending, 
aufgeben) abandoned) 


Ich erklare hiermit, dass alle von mir in der vorliegen- 
den Erklarung gemachten Angaben nach meinem 
besten Wissen und Gewissen der vollen Wahrheit 
entsprechen, und dass ich diese eidesstattliche Erkla- 
rung in Kenntnis dessen abgebe, dass wissentlich und 
vorsatzlich falsche Angaben gemass Paragraph 1001, 
Absatz 18 der Zivilprozessordnung der Vereinigten 
Staaten von Amerika mit Geldstrafe belegt und/oder 
Gefangnis bestraft werden koennen, und dass derartig 
wissentlich und vorsatzlich falsche Angaben die Gul- 
tigkeit der voriiegenden Patentanmeldung oder eines 
darauf erteilten Patentes gefahrden kbnnen. 


I hereby declare that all statements made herein of 
my own knowledge are true and that all statements 
made on information and belief are believed to be 
true, and further that these statements were made 
with the knowledge that willful false statements and 
the like so made are punishable by fine or imprison- 
ment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false state- 
ments may jeopardize the validity of the application or 
any patent issued thereon. 
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VERTRETUNGSVOLLMACHT: Als benannter Erfinder 
beauftrage ich hiermit den nachstehend benannten 
Patentanwalt (oder die nachstehend benannten Pa- 
tentanwalte) und/oder Patent-Agenten mit der Verfol- 
gung der vorliegenden Patentanmeldung sowie mit 
der Abwicklung aller damit verbundenen Geschafte 
vor dem Patent- und Warenzeichenamt: (Name und 
Registrationsnummer anfuhren) 



And I hereby appoint 

Messrs. John D. Simpson (Registration No . 19.842) Lew is T. Steadmani17 t 0Z4)JiA/aiiam C. Stueb er (16,453 L_P. Phillips Connor(19^59^Dennis A. Gross 
(24 1 41fl) 1 -Marvin Moodyj^&S^a^-SJeven H. Nol l (28,982), Br ett A. ValiquetjgL8JLlXXhornas i. RossJ29 l 275L_Kevin W. Guyn ngg^TTE dward A. Lehmann 
tg2 !312)Tja mes D. Hobart (24 I 149L - EP,bert I^arrety^Ol^Uaines Van Santen (16,§S&-^£rtriur Gr oss (13,615), Richa rd J. Schware (13,472) and 
TvfelvInA^obinso ri ^31 ,87gCT avidR7Metzge r (32,919), J ohn R. Garr ett (27,888) all m embers of the firm of HiffrSfeadman & Simpson, A ProfessToTTaTeoTpo- 
ration. ' / 

f J 



POWER OF ATTORNEY: As a named inventor, I 
hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all 
business in the Patent and Trademark Office connec- 
ted therewith, (list name and registration number) 



1. 



Direct Telephone Calls to: (name and telephone /turn- 
ber) 

312/876-0200 

Ext. 



Telefongesprache bitte richten an: 
(Name und Telefonnummer) 



Postanschrift: 



Send Correspondence to: 

HILL, STEAD MAN & SIMPSON 
- A Professi onal Corporation 
85t h Floor Sears Tower, Chicago, Illinois 606 06 



Voller Name des einzigen oder ursprunglichen Erfinders: 

PANDEL. Juraen , 


Full name of sole or first inventor: 


Unterschrift des Erfinders Datum 


Inventor's signature Date 


Wohnsitz E J3£^ 

D-83620JEMdtoc^^ Germany 


Residence 


Staatsangehorigkeit 

Bundesrepublik Deutschland 


Citizenship 


Postanschrift 

SchloBweg 17A 


Post Office Addess 


D-83620 Feldkirchen-Westerham 
Bundesrepublik Deutschland 




Voller Name des zweiten Miterfinders (falls zutreffend): 

MSE^Geco 


Full name of second joint inventor, if any: 


UnterschrtftiJes Erfinders.^ Datum 


Second Inventor's signature Date 


Wohns&z - s~ 

D-81739 Munchen. Germany U^)^ r^- 


Residence 


Staatsangehorigkeit 

Bundesrepublik Deutschland 


Citizenship 


Postanschrift 

Arno Assmann Str. 9 


Post Office Address 


D-81739 Munchen 
Bundesrepublik Deutschland 





(Bitte entsprechende (nformationen und Unterschriften im 
Falie von dritten und weiteren Miterfindern angeben). 



subsequent joint inventors). 
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Voller Name des dritten Miterfinders: 

OERTEL. Norbert 


Full name of third joint inventor: 


Untersohrifl des E^tindere//' X Datum 


Inventor's signature Date 


Wohnsitz 

D-80335 Munchen^Germany ( j^v^- 


Residence 


Staatsangehorigkeit *' 7 

Bundesrepublik Deutschland 


Citizenship 


Postanschrift 

Kreittmayrstr. 30 


Post Office Address 


D-80335 Munchen 
Bundesrepublik Deutschland 




Voller Name des vierten Miterfinders (falls zutreffend): 


Full name of fourth joint inventor, if any: 


Unterschrift des Erfinders Datum 


Inventor's signature Date 


Wohnsitz 


Residence 


Staatsangehorigkeit 


Citizenship 


Postanschrift 


Post Office Address 






Voller Name des funften Miterfinders (falls zutreffend): 


Full name of fifth joint inventor, if any: 


Unterschrift des Erfinders Datum 


Inventor's signature Date 


Wohnsitz 


Residence 


Staatsangehorigkeit 


Citizenship 


Postanschrift 


Post Office Address 






Voller Name des sechsten Miterfinders (falls zutreffend): 


Full name of sixth joint inventor, if any: 


Unterschrift des Erfinders Datum 


Inventor's signature Date 


Wohnsitz 


Residence 


Staatsangehorigkeit 


Citizenship 


Postanschrift 


Post Office Address 







(Bitte entsprechende Informationen und Unterschrift en im (Supply similar information and signature for third and 
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